o The Hentschel-Procaccia Conjecture 

o 
o 

£ Joseph L. McCauley 

d Physics Department 

University of Houston 
t-h Houston, Texas 7204 

jmccauley@uh.edu 



O Abstract 

o 

o 

"^3 Extensive confusion exists and persists in the literature on dynamical systems 

a 

£h theory, cosmology and other fields over spectra of fractal dimensions. Entirely 
different generating functions have been treated as if they should yield identical 
spectra, or scaling exponents. An uncritical implicit assumption of universality of 

j> scaling exponents is made, even though there is no good theoretical reason to expect 

•l-H 

^ universality away from criticality. Expectations based on the unphysical and 
empirically inapplicable zero length scale limit (which would require infinite 
precision in data analysis) are often taken for granted. A source of confusing together 
different generating functions can be traced back to the Hentschel-Procaccia 
conjecture, which I prove to be wrong for the case of data analysis in the only 
applicable limit, that of finite precision. The two different definitions of 
'multifractal' stated by Mandelbrot and by Halsey et al are compared and contrasted. 
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1. The empirical distribution and the optimal partition 



Mathematical theorems on infinite precision and infinite time limits are generally 
empirically inapplicable and misleading in the analysis of far from equilibrium 
dynamical systems. In contrast with our experience with natural phenomena 
described accurately by equilibrium statistical mechanics, chaotic dynamical systems 
can generate infinitely many different probability distributions depending on 
different classes of initial conditions. Theorists are therefore prone to assume that 
only one invariant measure (the one corresponding to 'measure one initial 
conditions) is preferred, although there is no known evidence for this in nature. 
From the standpoint of data analysis the most interesting probability distribution is 
the empirical distribution P(x), defined by the N data points collected from 
observation. I will concentrate on the empirical distribution, whatever it is, and for 
clarity and simplicity of mathematical description I restrict this discussion largely to 
one dimensional examples. 



Consider a (one dimensional) set of data points {xj. The empirical distribution P(x) is 
simply the fraction of points lying to the left of and including x, so that P(0)=1/N and 
P(l)=l, by construction. The distribution is constant on the voids and increases 
discontinuously at each data point, so that the plot of P(x) is a staircase of N-2 steps of 
finite width. The data staircase has the singular pointwise density p(x) = P'(x) given 
by 

dP(x) = f i |5(x-x i ) (i) 
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Equation (1) already an idealization. It neglects the error bars in the locations of 
measured positions. In reality each position should be specified empirically by a 
finite interval whose width is the uncertainty in location, but there is no a priori 
information on and therefore no precise definition of those error bars. I implicitly 
assume that the uncertainties in data point locations are very small relative to the 
smallest separation lmin between adjacent data points. Otherwise, coarsegraining 

and fractal / multifractal analysis are meaningless. 

Attempts to 'smooth' the empirical staircase (via splines, e.g.) will discard important 
information about voids and clustering. No pointwise probability distribution other 
than the observed staircase 



is relevant for empirical data analysis. 

Contrast this with dynamical systems theory. While probability distributions 
generated by a chaotic system are not unique, certain chaotic and critical dynamical 
systems do admit 'generating partitions', which define a hierarchy of unique optimal 
coarsegrainings of phase space (optimal coarsegrainings of the unique support of all 
probability distributions generated by the dynamical system). In that case topological 
universality classes can be defined [1-4] via symbolic dynamics. I call the generating 
partition the optimal [5] or natural [6] partition because it is the realization of the 
idea of the infimum in the definition of a multifractafractal point set [7], and because 
it is generated by the dynamical system. On a generating partition a coarsegrained 




(2) 
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probability Pi is then defined by the difference Pi=AP(x) over the i tn closed interval of 
size l;( n ), and is just the fraction Pi=ni/N of the total number of data points ni in the 
ith interval including the end points. While a pointwise theoretical distribution P(x) 
(not unique!) is a staircase of infinitely-many steps, each corresponding 
coarsegrained distribution {Pi} of P(x) is a histogram on the (unique) finite support 
defined by the hierarchy of intervals defining the generating partition. The 
generating partition optimally defines the support of the hierarchy of coarsegrained 
distribution {Pi}. An arbitrarily constructed partition of empirical data is generally 

not the generating partition of a deterministic dynamical system and usually cannot 
yield an accurate estimate of a Hausdorff dimension because of 'convergence 
problems' arising from the limited number of points in the sample (see part 2 
below). 

I prefer the frequency definition of probabilities because it arises naturally in both 
empirical data analysis and computer simulations. An idealized staircase 
distribution resulting from infinite precision and infinite time limits of a particular 
dynamical system (the ternary tent map) is provided by the Cantor function [6,8] 

P(x) = 

22 2 , (3) 

where, because x = .£i...£n— is a ternary number with 8i = or 2, P(x) is a binary 
number (because £i/2 = or 1). This staircase describes a mathematician's 
idealization of empirical data, namely, one distribution (of infinitely-many 
distributions) consisting of all points in the middle-thirds Cantor set: P(0)=0, P(l) =1, 
P(x) is constant on the open voids and increases discontinuously at the end point of 
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any closed interval l( n ) = 3" n of the optimal covering, the generating partition of the 
ternary tent map, where the change in P(x) is in this case AP = 2~ n . The Cantor 
function defines a hierarchy of uniform coarsegrained distributions 
Pi = AP(x)= N n " 1 = 2" n on the fractal support l( n ) = 3~ n , for each generation n in the 

hierarchy. This is by far not the only probability distribution that is generated by the 
ternary tent map [6]. Multifractal, and also nonuniform, nonfractal distributions are 
easily generated by the tent map on the same support by other classes of initial data 
that are easy to find in computation [6]. 

Summarizing, empirically, I assume only a collection of N raw data points (from a 
time series, perhaps) generated by a typically unknown deterministic dynamical 
system, or random process. Only in the former case do we have even the remote 
possibility of finding a generating partition. We can construct the empirical 
distribution P(x) immediately from the data, but we cannot construct 
geometrically / topologically meaningful coarsegrained distributions {Pi} unless we 
can find an optimal partition {li}. In dynamical systems theory an optimal partition 
is provided by the generating partition, whenever the generating partition exists 
(tent, logistic, Lozi and Henon maps admit generating partitions, e.g.). The 
generating partition is the signature of the dynamical system, and shows how the 
dynamics coarsegrains phase space naturally. The histograms that appear on the 
optimal support can be produced by every dynamical system in the same topologic 
universality class: symbolic dynamics is universal for all systems in the same 
universality class [2-4]. On the other hand, a particular statistical distribution {Pi} 

cannot be the signature of a particular deterministic dynamical system [6]. Complex 
systems generate neither a unique probability distribution nor a generating partition 
[9,10]. Both the Henon map and the logistic map f(x) = Dx(l-x), with D C <D<4 where 
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D c is the period doubling critical point, belong to the same topologic universality 
class [2] (the logistic map with D>4 and the binary tent map belong to a separate 
universality class [6]). Both systems, although of different spatial dimension, 
generate the same range of histograms (for corresponding classes of initial 
conditions), but on different coarsegrained supports. From the perspective of both 
dynamical systems theory and the search for scale invariance the central problem of 
data analysis is to extract the optimal partition from a particular set of data points. 
See [11,12] for examples of attempts to extract optimal partitions from observational 
data in fluid mechanics. 
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2. Confusing together different generating functions 

The word 'multifractal' is not uniquely defined in the literature. It is sometimes 
defined, as e.g. in [13], by requiring that the moments of an arbitrary probability 
distribution P(X,L), 



(X^ 1 ) =IP(X,L)X^' 

x ,(4) 



where X is a random value defined in or on intervals of size L, scale like 

(X"- 1 } (5 ) 

for small enough interval sizes L (or, in aggregation or cosmology, for large enough 
L). Without further requirements on X and P(X,L), however, there is no reason to 
expect that scaling exponents in (5), if they exist at all for a given distribution P(X,L), 
bear any relation to multifractal spectra of fractal dimensions D(X) derivable from 
the generating function 



Z n (P) =Zf =EN(X)1(X) p -Ee-w-i* 

' 1 } , (5) 



which characterizes the fractal via an optimal partition {1}, or to generalized 
dimensions D q derivable from f(cc) defined by 
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Xn(q) = 




or 

r n (q) =ZKccr- f(a) - T =1 

(5c) 

where the effects of the optimal partition and coarsegrained probability distribution 
on that optimal support are tangled together irreversibly. Without further 
assumptions there is nothing inherently fractal about either X or P(X,L) in (4). More 
on this below. 

The generating function (4) combined with the scaling expectation (5) is used in 
definitions of multiaffine fractals [14], where a deterministic or random variable (or 
field) X is continuous but has singular (or no) derivatives. If the distribution of 
singularities of the field X can be described locally by writing X ~ L n and 
P(X,L) ~ L~f(h), then (17) may or may not yield scaling exponents ^ p that give rise to a 

spectrum of generalized dimensions defined by (p-l)Dp = pa(p) - f(a(p)) in the 
infinite precision limit L — > 0, where D Q/ D\, and D2 are fractal dimensions of 

something in the model. This holds only when f(h) describes a spectrum of fractal 
dimensions, but merely calling (4) and (5) 'multifractal' certainly does not make this 
true. In the latter case, h and f(h) are just a rewriting of a nonfractal probability 
distribution P(X,L) via a differentiable coordinate transformation, and nonfractal 
distributions cannot be made fractal (or the converse) by a differentiable coordinate 
transformation. Stated another way, f(h) is not a spectrum of fractal dimensions of 
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an underlying support of the distribution P unless "L" in (5) represents an optimal 
or at least efficient partition of the support of the underlying pointwise distribution 
P(x). Examples in the literature where X~L n with P(X,L) ~ L"f( n ) are used without 
any requirement of the optimal partitioning of a support are height fluctuations in 
surface roughening [14], self-organized criticality [15] and velocity structure functions 
in the inertial range of fluid turbulence [16]. For random fractals is no idea of a 
generating partition, or optimal partition. Examples of multiaffine fractals can be 
generated both randomly and deterministically [14]. 

Another source of confusion in the attempt to calculate fractal dimensions and 
spectra of fractal dimensions, recently in cosmology [17,18] and much earlier 
dynamical systems theory (before the advent of using the optimal partition [1], 
especially in the recycling [2] of strange sets, comes from using the correlation 
integral 

1 N 

n(r) = M Z n,(r) 
where 

1 N 

ni(r) =j^.Z e ( r "| x i " x j|) 

i*-/ (7) 

is the fraction of points in a ball of size r, centered on the of N points in some 
distribution. We can always rescale the data to take 0<r<l. The main point in what 
follows is that no idea of an optimal partition is required in (6), although (6) is 
consistent with an optimal partition, if one exists. 
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In the limit of small length scales r (or, as in cosmology or DLA, in the limit of large 
r) the generalized dimension D2 coincides with the correlation integral dimension v 
whenever 

n(r) =r v ( 8 ) 

for 'small enough r' whenever an empirical distribution P(x) exhibits statistical 
independence on its optimal coarsegrained support [20]. We cannot merely assume 
statistical independence of observational data. Therefore we can not normally expect 
to be able to extract D2 from data analysis. Loosely speaking, however, I will still refer 
to v as the "correlation dimension" in agreement with widespread usage of that term 
in the literature, and because empirical data nearly never show statistical 
independence. 

A popular generalization of (6) is defined by the generating function 
G n (q)4f n,(rr' ^ 

As in (6), N is not the number of intervals in a nonoverlapping, efficient (if not 
optimal) partition but is the number of points in the data sample. The correlation 
integral (6) and its generalization (9) have been emphasized in the literature 
precisely because they appear to allow us to avoid the need to find an optimal 
partitioning. 
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An optimal partition realizes the requirement of imposing an infimum condition [7] 
on the choice of partition used in calculating the generating functions (5b,c). 
Avoiding the infimum condition is attractive, because without knowing a 
generating partition, which can be devilishly hard or impossible to extract from raw 
data, it's hard to know how to impose the infimum condition. Therefore the 
popularity of (6) and (9) in data anaylsis. This 'short-circuit', unfortunately, is only an 
illusion, as I will now explain. 

With only very limited data (nearly always the case empirically), the generating 
function (9) generally cannot be expected to yield either a Hausdorff or box-counting 
dimension (topologic entropy). Setting q=0 in (9), one might hope that v Q in 

<«<» (10) 

would provide an estimate for the box counting dimension D Q . This is generally 

impossible, because neither the box counting nor information dimension is 
included in the Vq spectrum when there is no underlying generating partition. An 

appeal to the unphysical limit of vanishing r [21] does not help and is instead very 
misleading in the empirical case. The reason for the deficit is simple: the terms on 
the left right side of (10), taken alone without further assumptions, don't define an 
efficient, nonoverlapping partition of G n (0) intervals, each of size r. Hence, the 

"convergence" difficulties reported in [22] in the attempt to estimate the box 
counting dimension by computing v Q in cosmology, where overlapping intervals 

occured. 
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If, following [22], we would try, instead, to define an interval ri formally by writing 
rVniO")- 1 ) = ri d in (10), then the result 



1 N 

ly „ i 

Nitl r ' 1 



(ii) 



reminds us of the definition of the Hausdorff dimension if we would take the 
infimum over all possible partitions, but in the absence of that condition the 
exponent d in (11) does not define a Hausdorff dimension: the N intervals rj may 
overlap with each other because the sum in [22] is over all N data points instead of 
over an efficient partition. The problem is that the required infimum condition [7] 
was not imposed in using the definition (11): Equation (11) was proposed in [23] as 
one that yields Du, as well as the Dq spectrum for q<l via the generalization [23b] 



but information about the spectrum of generalized dimensions Dq, aside from a 
possible estimate of D2, is not included in these formulae. 

Equation (11) as used in [23] is supposed to be based on the equation 



W n (t) 




,-t 



P 



q 



, (12) 



N 

i= 1 



N 



(13) 



with 



r, 



N 



KN 



(14) 
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as used in [24], where ri is the nearest neighbor distance between two points in a 
sample consisting of N points. However, in [24] the partitioning used to compute 
(13) via an example was chosen to be nonoverlapping: it is the generating partition 
of the binary tent map, whereas in [23] an overlapping partition was used implicitly. 

In a spirit similar to the attempt to define "multifractal" by using the moments (4) of 
an arbitrary distribution p(X,L) with a scaling law (5), the definition 



where the probability distribution p(P,L) is arbitrary and is generally undefined, is 
treated in various places [25] as if it would be identical with the generating function 



although it generally is not due to the lack of an optimal partition in the definition 



For an arbitrary probability distribution p(P,L) the two generating functions (15) and 
(5b') are not even related. Their scaling exponents, if scaling exponents exist at all in 
either case, are generally not the same, as I explain in the main result in part 3 below. 
Multifractal spectra and generalized dimensions are not universal. Instead, they 
change with the histograms and their coarsegrained support (partition). I emphasize 
that it is necessary to think in terms of the finite precision limit and to avoid the 



(P"- 1 } =Zp(P,DP q 



- 1 



(15) 




(15). 
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unphysical limit of vanishing length scale. Otherwise, the results derived may have 
no empirical applicability. In fractal analysis of observations of nature, everything 
lies in the finite precision realm. Infinite precision limits combined with appeals to 
'finite size effects' ala critical phenomena are inapplicable and misleading in the 
analysis of far from equilibrium dynamical systems. Resort to thermal equilbrium 
versions of 'finite size effects' completely irrelevant here. 

3. The Hentschel-Procaccia Conjecture 

A common source (oft quoted in the literature) of license to confuse together 
entirely different generating functions can be traced to a speculation based on the 
zero length scale limit in paper on dynamical systems theory written over sixteen 
years ago, the Hentschel-Procaccia conjecture. Hentschel and Procaccia boldly 
suggested [20] (see also [24]) that (5b) is analogous to the Lebesgue integral 



and should yield the same generalized dimensions Dq in the small L limit, where 
P(x) is supposed to be "the natural invariant measure" of a chaotic dynamical system 
on a strange attractor (see [26] for one definition of "natural measure") and where 
P(Bl(x)) is the fraction of points lying within a ball of size L covering (but not 
necessarily centered on) a data point x. There are two reasons that may prevent the 
replacement of (5b) by (16) in data analysis, both centering on lack of uniqueness. 

First, there is no empirical evidence that a far from equilibrium dynamical system 
generates a unique "natural measure" for the various possible initial conditions, 




(16) 
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meaning "present conditions" found in nature. Mathematically seen, an isolated 
chaotic dynamical system can generate infinitely many different distributions 
(probability measures) P(x) for infinitely many different classes of initial conditions 
[5,6]. Empirically, this dependence of observed dynamics on initial conditions does 
not create a difficulty: empirical data are described by the staircase function 



where the {xj are the observed data points. Without making any special theoretical 
assumptions that might bias a data analysis, we can simply say that the initial 
conditions, whatever they were, produced the empirical distribution P(x) via the 
time evolution of the dynamical system, whatever it is. Furthermore, the details of 
the empirical distribution (2) could even be eliminated by using the generating 
function (5) to extract D(X) from the data, if a generating partition can be found from 
the data. Now for my main point. 

Given an empirical measure (3b), and even a possible underlying explanatory 
dynamical model with a generating partition, there is still ambiguity inherent in the 
attempt to use (16) as a replacement for (5b). In finite precision there are infinitely 
many different possible results the integral (16), depending on which subset of the 
data set we decide to measure. In particular, before we can identify the function 
P(Bl(x)) we must first define what we mean by "L". Here, I consider the two main 

possibilities discussed in the literature. These two possibilities were conjectured [20] 
(before the discovery of 'recycling' [2]) to yield the same result in the infinite 
precision limit (where L vanishes), but I will now show that they do not yield the 




(2) 
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same result in the finite precision regime. Please bear in mind that I have explained 
above why, when "L" is finite, (5b) and (9) yield entirely different spectra of scaling 
exponments, if scaling exists at all. 

If we choose the balls /intervals Bl(x) to have arbitrary length L centered on a data 
point xi (as in [27]), then the fraction of points lying within each interval of size L is 
given by P(Bl(x)) = n(x,L) where n(xi,L) = ni(L) with 



nKL) 



1 



(7b) 



If we use the pointwise definitions P(Bl(x)) = n(x,L) and 



N 



dP(x) = |Z8(x -x.) (i) 



in the integral (16) then we obtain the correlation integral generating function 
JdP(x)P(B 1 (x)) q - 1 = ^£n i (l) q_1 =G n (q) 



, (9b) 



which differs significantly from (5b) in data analysis because it makes no reference to 
an optimal partition and therefore cannot be used to find Hausdorff (or even box 
counting) dimension for arbitrary (non-optimal partionable) data. 



As an aside, in dynamical systems theory the N intervals can in principle be chosen 
small enough not to overlap with each other: ideally, on a mathematically-defined 
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strange attractor there exist in principle t°° points in any neighborhood of any 
arbitrary point xi on the attractor, where t°° is the cardinality of the attractor. Here, as 
opposed to applications to cosmology, the N intervals (or balls) Bl of size L can be 
chosen small enough not to overlap, but generally do not partition the attractor 
optimally. The topologic entropy can be calculated from N and t. Equation (6), which 
was not invented with partitioning in mind, defines a time average over N points 
on the attractor, and the uniform weight 1 / N is correct because each point xi occurs 

exactly once (so long as trajectories of the dynamical system are unique, which we 
assume here). In calculations the number N of points can be increased by increasing 
the precision of the calculation. In cosmology, in contrast, N is the total number of 
galaxies in a finite sample, so that the N intervals of size 1 are always overlapping, at 
least with currently- available data [28]. 

The important point is that there is a different way to define balls Bl(x) and a 
corresponding measure P(Bl(x)). The choice of which function to integrate with 

respect to the measure is not unique. Instead of choosing N uniform intervals where 
N is the number of data points, requiring the pointwise definition P(Bl(x)) = n(x,L) 

as given by (7b) (which does not include or depend on a partition of the data set), we 
can instead choose our balls Bl to be the Nn intervals {li} in the optimal partition of 

the data, if the data are generated by a dynamical system with a generating partition. 
In this case P(Bl(x)) is given by the simple function 

P(B,(x)) =ZP i X li (x) 
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where X\W is the characteristic function for the partition {li} of disjoint intervals [29] 
and 

i + n, - 1 

p ; = p( Xi +10 - p( Xi ) =i £ e( Xi + n _ - Xj ) = ^ 

J = i . (18) 

Here, xi and xi+ n i = xi+li are taken to be the end points of any of the N n optimal 
intervals {li}. With this optimal choice of "what to measure" (optimal choice of 
function P(Bl(x)) to integrate with respect to the measure P(x)) the integral (16) yields 

dPWP^x))"- 1 = tm q 1 =x„(q) 

J 1 . (5b") 

From the standpoint of both data analysis and measure theory the only significant 
difference between the distributions (5b) and (9) is the lack of a partition in (9), and 
the use of an optimal partition to define (5b). Whether these two generating 
functions do or do not, in the limit of ^ ' ~* ® for a mathematical fractal of 
cardinality t 00 , yield the same generalized dimensions (whether Dq = Vq as ^ 

is completely irrelevant for the correct analysis of empirical data. 
4. Two main definitions of 'multifractal' 

A Cramer function [16,30] provides a systematic way of obtaining a universal result 
X-L* 1 and P(X / L)~L" f (^ 1 ) via a limit theorem in classical statistics, for the case where 
the hi exist and are independent random variables. This result has no necessary 
connection with the idea of spectra of fractal dimensions D(X), or generalized 
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dimensions D q derivable from spectra of fractal dimensions f(a). The Cramer 
function, emphasized by Mandelbrot and Frisch, is based on the law of large 
numbers and may appear in completely nonfractal contexts, such as classical 
statistical mechanics. The generating functions (5b) and (5c) were, in contrast, 
invented to handle singularities of probability distributions, especially as appear in 
deterministic dynamics on a Cantor set (the condition of the infimum [7] required in 
defining (5b,c) is satisfied by a generating partition). However, in a paper that 
includes one of the coauthors of Halsey et al [30] as author, the Cramer function was 
used, was called "multifractal", and then the paper by Halsey et al [30] was cited as the 
reference [15]. However, the Cramer function is not defined or mentioned in [30]! 

One can choose to follow Halsey et al [30] in defining f (a) and Dq, or one can follow 
Mandelbrot [29] in defining "v(a) and dq" via Cramer functions [16], but one should 
not mix the two separate definitions together without comment as is done in [13,15]. 
I recommend the definition of multifractal given in [30] as the standard because, in 
that case, f(oc) is always the Hausdorff dimension of a subset of the support of a 
distribution P(x). The necessity of an optimal partition in order to define f(a) was 
stated in Halsey et al [30] (see their "infimum" requirement), but was not 
emphasized strongly enough within the fractals community at that time. The role 
played by the generating partition in defining fractal attractors became clear only 
after later advanced work in dynamical systems theory [1,2,4]. Mandelbrot originally 
proposed the Cramer function as a replacement for f(cc) because the infimum 
condition required to calculate Hausdorff dimensions [7] is so hard to implement in 
practice, and also because he so often emphasizes randomness (as opposed to 
determinism) in his discussions of fractals (in the finance, e.g., where evidence for 
randomness abounds while evidence for determinism has not yet been found). 
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Spectra of fractal dimensions that satisfy the infimum condition have, nevertheless 
been calculated via generating partitions [1,4]. Empirical data have been analyzed on 
the same basis [11]. The large n limit (or small L limit) may no easier to implement 
in practice than is the problem of finding an efficient partition. In many cases 
evidence for neither can be found, but the 'convergence' difficulties that generally 
occur when trying to compute fractal dimensions via box-counting by using an 
arbitrary partition can only be reduced or eliminated by the use of the optimal or at 
least efficient [28] partition. 
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